Pandas Profiling Report

Dataset statistics

Number of variables	22
Number of observations	21613
Missing cells	320
Missing cells (%)	0.1%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	3.6 MiB
Average record size in memory	176.0 B

Variable types

DateTime	1
Numeric	14
Categorical	7

Alerts

`price` is highly correlated with `sqft_living` and 3 other fields	High correlation
`bedrooms` is highly correlated with `bathrooms` and 2 other fields	High correlation
`bathrooms` is highly correlated with `bedrooms` and 6 other fields	High correlation
`sqft_living` is highly correlated with `price` and 5 other fields	High correlation
`sqft_lot` is highly correlated with `sqft_lot15`	High correlation
`floors` is highly correlated with `bathrooms` and 3 other fields	High correlation
`grade` is highly correlated with `price` and 6 other fields	High correlation
`sqft_above` is highly correlated with `price` and 6 other fields	High correlation
`yr_built` is highly correlated with `bathrooms` and 2 other fields	High correlation
`sqft_living15` is highly correlated with `price` and 4 other fields	High correlation
`sqft_lot15` is highly correlated with `sqft_lot`	High correlation
`price` is highly correlated with `bathrooms` and 4 other fields	High correlation
`bedrooms` is highly correlated with `bathrooms` and 1 other fields	High correlation
`bathrooms` is highly correlated with `price` and 7 other fields	High correlation
`sqft_living` is highly correlated with `price` and 5 other fields	High correlation
`sqft_lot` is highly correlated with `sqft_lot15`	High correlation
`floors` is highly correlated with `bathrooms` and 1 other fields	High correlation
`grade` is highly correlated with `price` and 4 other fields	High correlation
`sqft_above` is highly correlated with `price` and 5 other fields	High correlation
`yr_built` is highly correlated with `bathrooms`	High correlation
`sqft_living15` is highly correlated with `price` and 4 other fields	High correlation
`sqft_lot15` is highly correlated with `sqft_lot`	High correlation
`price` is highly correlated with `grade`	High correlation
`bedrooms` is highly correlated with `sqft_living`	High correlation
`bathrooms` is highly correlated with `sqft_living` and 2 other fields	High correlation
`sqft_living` is highly correlated with `bedrooms` and 4 other fields	High correlation
`sqft_lot` is highly correlated with `sqft_lot15`	High correlation
`grade` is highly correlated with `price` and 4 other fields	High correlation
`sqft_above` is highly correlated with `bathrooms` and 3 other fields	High correlation
`sqft_living15` is highly correlated with `sqft_living` and 2 other fields	High correlation
`sqft_lot15` is highly correlated with `sqft_lot`	High correlation
`condition` is highly correlated with `condition_type`	High correlation
`view` is highly correlated with `waterfront`	High correlation
`condition_type` is highly correlated with `condition`	High correlation
`waterfront` is highly correlated with `view`	High correlation
`price` is highly correlated with `bathrooms` and 6 other fields	High correlation
`bedrooms` is highly correlated with `bathrooms` and 2 other fields	High correlation
`bathrooms` is highly correlated with `price` and 9 other fields	High correlation
`sqft_living` is highly correlated with `price` and 7 other fields	High correlation
`sqft_lot` is highly correlated with `sqft_lot15`	High correlation
`floors` is highly correlated with `yr_built` and 1 other fields	High correlation
`condition` is highly correlated with `yr_built` and 1 other fields	High correlation
`grade` is highly correlated with `price` and 5 other fields	High correlation
`sqft_above` is highly correlated with `price` and 7 other fields	High correlation
`sqft_basement` is highly correlated with `price` and 3 other fields	High correlation
`yr_built` is highly correlated with `bathrooms` and 4 other fields	High correlation
`lat` is highly correlated with `price_tier`	High correlation
`long` is highly correlated with `yr_built`	High correlation
`sqft_living15` is highly correlated with `price` and 5 other fields	High correlation
`sqft_lot15` is highly correlated with `sqft_lot`	High correlation
`house_age` is highly correlated with `bathrooms` and 3 other fields	High correlation
`dormitory_type` is highly correlated with `bathrooms`	High correlation
`condition_type` is highly correlated with `condition`	High correlation
`price_tier` is highly correlated with `price` and 4 other fields	High correlation
`house_age` has 320 (1.5%) missing values	Missing
`sqft_basement` has 13126 (60.7%) zeros	Zeros

Reproduction

Analysis started	2022-04-30 15:08:16.557314
Analysis finished	2022-04-30 15:09:07.691707
Duration	51.13 seconds
Software version	pandas-profiling v3.1.0
Download configuration	config.json

date
Date

Distinct	372
Distinct (%)	1.7%
Missing	0
Missing (%)	0.0%
Memory size	169.0 KiB

Minimum	2014-05-02 00:00:00
Maximum	2015-05-27 00:00:00

Histogram

Histogram with fixed size bins (bins=50)

price
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	4028
Distinct (%)	18.6%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	540088.1418

Minimum	75000
Maximum	7700000
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	169.0 KiB

Quantile statistics

Minimum	75000
5-th percentile	210000
Q1	321950
median	450000
Q3	645000
95-th percentile	1156480
Maximum	7700000
Range	7625000
Interquartile range (IQR)	323050

Descriptive statistics

Standard deviation	367127.1965
Coefficient of variation (CV)	0.6797542255
Kurtosis	34.58554043
Mean	540088.1418
Median Absolute Deviation (MAD)	150000
Skewness	4.024069145
Sum	1.167292501 × 10¹⁰
Variance	1.347823784 × 10¹¹
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
350000	172	0.8%
450000	172	0.8%
550000	159	0.7%
500000	152	0.7%
425000	150	0.7%
325000	148	0.7%
400000	145	0.7%
375000	138	0.6%
300000	133	0.6%
525000	131	0.6%
Other values (4018)	20113	93.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
75000	1	< 0.1%
78000	1	< 0.1%
80000	1	< 0.1%
81000	1	< 0.1%
82000	1	< 0.1%
82500	1	< 0.1%
83000	1	< 0.1%
84000	1	< 0.1%
85000	2	< 0.1%
86500	1	< 0.1%

Value	Count	Frequency (%)
7700000	1	< 0.1%
7062500	1	< 0.1%
6885000	1	< 0.1%
5570000	1	< 0.1%
5350000	1	< 0.1%
5300000	1	< 0.1%
5110800	1	< 0.1%
4668000	1	< 0.1%
4500000	1	< 0.1%
4489000	1	< 0.1%

bedrooms
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	13
Distinct (%)	0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	3.370841623

Minimum	0
Maximum	33
Zeros	13
Zeros (%)	0.1%
Negative	0
Negative (%)	0.0%
Memory size	169.0 KiB

Quantile statistics

Minimum	0
5-th percentile	2
Q1	3
median	3
Q3	4
95-th percentile	5
Maximum	33
Range	33
Interquartile range (IQR)	1

Descriptive statistics

Standard deviation	0.9300618311
Coefficient of variation (CV)	0.2759138325
Kurtosis	49.06365318
Mean	3.370841623
Median Absolute Deviation (MAD)	1
Skewness	1.974299535
Sum	72854
Variance	0.8650150098
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=13)

Value	Count	Frequency (%)
3	9824	45.5%
4	6882	31.8%
2	2760	12.8%
5	1601	7.4%
6	272	1.3%
1	199	0.9%
7	38	0.2%
0	13	0.1%
8	13	0.1%
9	6	< 0.1%
Other values (3)	5	< 0.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	13	0.1%
1	199	0.9%
2	2760	12.8%
3	9824	45.5%
4	6882	31.8%
5	1601	7.4%
6	272	1.3%
7	38	0.2%
8	13	0.1%
9	6	< 0.1%

Value	Count	Frequency (%)
33	1	< 0.1%
11	1	< 0.1%
10	3	< 0.1%
9	6	< 0.1%
8	13	0.1%
7	38	0.2%
6	272	1.3%
5	1601	7.4%
4	6882	31.8%
3	9824	45.5%

bathrooms
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	30
Distinct (%)	0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	2.114757322

Minimum	0
Maximum	8
Zeros	10
Zeros (%)	< 0.1%
Negative	0
Negative (%)	0.0%
Memory size	169.0 KiB

Quantile statistics

Minimum	0
5-th percentile	1
Q1	1.75
median	2.25
Q3	2.5
95-th percentile	3.5
Maximum	8
Range	8
Interquartile range (IQR)	0.75

Descriptive statistics

Standard deviation	0.7701631572
Coefficient of variation (CV)	0.3641851238
Kurtosis	1.279902444
Mean	2.114757322
Median Absolute Deviation (MAD)	0.5
Skewness	0.5111075733
Sum	45706.25
Variance	0.5931512887
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=30)

Value	Count	Frequency (%)
2.5	5380	24.9%
1	3852	17.8%
1.75	3048	14.1%
2.25	2047	9.5%
2	1930	8.9%
1.5	1446	6.7%
2.75	1185	5.5%
3	753	3.5%
3.5	731	3.4%
3.25	589	2.7%
Other values (20)	652	3.0%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	10	< 0.1%
0.5	4	< 0.1%
0.75	72	0.3%
1	3852	17.8%
1.25	9	< 0.1%
1.5	1446	6.7%
1.75	3048	14.1%
2	1930	8.9%
2.25	2047	9.5%
2.5	5380	24.9%

Value	Count	Frequency (%)
8	2	< 0.1%
7.75	1	< 0.1%
7.5	1	< 0.1%
6.75	2	< 0.1%
6.5	2	< 0.1%
6.25	2	< 0.1%
6	6	< 0.1%
5.75	4	< 0.1%
5.5	10	< 0.1%
5.25	13	0.1%

sqft_living
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	1038
Distinct (%)	4.8%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	2079.899736

Minimum	290
Maximum	13540
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	169.0 KiB

Quantile statistics

Minimum	290
5-th percentile	940
Q1	1427
median	1910
Q3	2550
95-th percentile	3760
Maximum	13540
Range	13250
Interquartile range (IQR)	1123

Descriptive statistics

Standard deviation	918.440897
Coefficient of variation (CV)	0.4415794093
Kurtosis	5.24309299
Mean	2079.899736
Median Absolute Deviation (MAD)	540
Skewness	1.471555427
Sum	44952873
Variance	843533.6814
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1300	138	0.6%
1400	135	0.6%
1440	133	0.6%
1800	129	0.6%
1660	129	0.6%
1010	129	0.6%
1820	128	0.6%
1480	125	0.6%
1720	125	0.6%
1540	124	0.6%
Other values (1028)	20318	94.0%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
290	1	< 0.1%
370	1	< 0.1%
380	1	< 0.1%
384	1	< 0.1%
390	2	< 0.1%
410	1	< 0.1%
420	2	< 0.1%
430	1	< 0.1%
440	1	< 0.1%
460	1	< 0.1%

Value	Count	Frequency (%)
13540	1	< 0.1%
12050	1	< 0.1%
10040	1	< 0.1%
9890	1	< 0.1%
9640	1	< 0.1%
9200	1	< 0.1%
8670	1	< 0.1%
8020	1	< 0.1%
8010	1	< 0.1%
8000	1	< 0.1%

sqft_lot
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	9782
Distinct (%)	45.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	15106.96757

Minimum	520
Maximum	1651359
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	169.0 KiB

Quantile statistics

Minimum	520
5-th percentile	1800
Q1	5040
median	7618
Q3	10688
95-th percentile	43339.2
Maximum	1651359
Range	1650839
Interquartile range (IQR)	5648

Descriptive statistics

Standard deviation	41420.51152
Coefficient of variation (CV)	2.741815082
Kurtosis	285.0778197
Mean	15106.96757
Median Absolute Deviation (MAD)	2618
Skewness	13.06001896
Sum	326506890
Variance	1715658774
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
5000	358	1.7%
6000	290	1.3%
4000	251	1.2%
7200	220	1.0%
4800	120	0.6%
7500	119	0.6%
4500	114	0.5%
8400	111	0.5%
9600	109	0.5%
3600	103	0.5%
Other values (9772)	19818	91.7%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
520	1	< 0.1%
572	1	< 0.1%
600	1	< 0.1%
609	1	< 0.1%
635	1	< 0.1%
638	1	< 0.1%
649	2	< 0.1%
651	1	< 0.1%
675	1	< 0.1%
676	1	< 0.1%

Value	Count	Frequency (%)
1651359	1	< 0.1%
1164794	1	< 0.1%
1074218	1	< 0.1%
1024068	1	< 0.1%
982998	1	< 0.1%
982278	1	< 0.1%
920423	1	< 0.1%
881654	1	< 0.1%
871200	2	< 0.1%
843309	1	< 0.1%

floors
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	6
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	1.494308981

Minimum	1
Maximum	3.5
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	169.0 KiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	1
median	1.5
Q3	2
95-th percentile	2
Maximum	3.5
Range	2.5
Interquartile range (IQR)	1

Descriptive statistics

Standard deviation	0.5399888951
Coefficient of variation (CV)	0.361363615
Kurtosis	-0.4847229368
Mean	1.494308981
Median Absolute Deviation (MAD)	0.5
Skewness	0.6161767212
Sum	32296.5
Variance	0.2915880069
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=6)

Value	Count	Frequency (%)
1	10680	49.4%
2	8241	38.1%
1.5	1910	8.8%
3	613	2.8%
2.5	161	0.7%
3.5	8	< 0.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	10680	49.4%
1.5	1910	8.8%
2	8241	38.1%
2.5	161	0.7%
3	613	2.8%
3.5	8	< 0.1%

Value	Count	Frequency (%)
3.5	8	< 0.1%
3	613	2.8%
2.5	161	0.7%
2	8241	38.1%
1.5	1910	8.8%
1	10680	49.4%

waterfront
Categorical

HIGH CORRELATION

Distinct	2
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	169.0 KiB

0	21450
1	163

Length

Max length	1
Median length	1
Mean length	1
Min length	1

Characters and Unicode

Total characters	0
Distinct characters	0
Distinct categories	0 ?
Distinct scripts	0 ?
Distinct blocks	0 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	0
2nd row	0
3rd row	0
4th row	0
5th row	0

Common Values

Value	Count	Frequency (%)
0	21450	99.2%
1	163	0.8%

Length

Histogram of lengths of the category

Pie chart

Value	Count	Frequency (%)
0	21450	99.2%
1	163	0.8%

Most occurring characters

Value	Count	Frequency (%)
No values found.

Most occurring categories

Value	Count	Frequency (%)
No values found.

Most frequent character per category

Most occurring scripts

Value	Count	Frequency (%)
No values found.

Most frequent character per script

Most occurring blocks

Value	Count	Frequency (%)
No values found.

Most frequent character per block

view
Categorical

HIGH CORRELATION

Distinct	5
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	169.0 KiB

0	19489
2	963
3	510
1	332
4	319

Length

Max length	1
Median length	1
Mean length	1
Min length	1

Characters and Unicode

Total characters	0
Distinct characters	0
Distinct categories	0 ?
Distinct scripts	0 ?
Distinct blocks	0 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	0
2nd row	0
3rd row	0
4th row	0
5th row	0

Common Values

Value	Count	Frequency (%)
0	19489	90.2%
2	963	4.5%
3	510	2.4%
1	332	1.5%
4	319	1.5%

Length

Histogram of lengths of the category

Pie chart

Value	Count	Frequency (%)
0	19489	90.2%
2	963	4.5%
3	510	2.4%
1	332	1.5%
4	319	1.5%

Most occurring characters

Value	Count	Frequency (%)
No values found.

Most occurring categories

Value	Count	Frequency (%)
No values found.

Most frequent character per category

Most occurring scripts

Value	Count	Frequency (%)
No values found.

Most frequent character per script

Most occurring blocks

Value	Count	Frequency (%)
No values found.

Most frequent character per block

condition
Categorical

HIGH CORRELATION
HIGH CORRELATION

Distinct	5
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	169.0 KiB

3	14031
4	5679
5	1701
2	172
1	30

Length

Max length	1
Median length	1
Mean length	1
Min length	1

Characters and Unicode

Total characters	0
Distinct characters	0
Distinct categories	0 ?
Distinct scripts	0 ?
Distinct blocks	0 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	3
2nd row	3
3rd row	3
4th row	5
5th row	3

Common Values

Value	Count	Frequency (%)
3	14031	64.9%
4	5679	26.3%
5	1701	7.9%
2	172	0.8%
1	30	0.1%

Length

Histogram of lengths of the category

Pie chart

Value	Count	Frequency (%)
3	14031	64.9%
4	5679	26.3%
5	1701	7.9%
2	172	0.8%
1	30	0.1%

Most occurring characters

Value	Count	Frequency (%)
No values found.

Most occurring categories

Value	Count	Frequency (%)
No values found.

Most frequent character per category

Most occurring scripts

Value	Count	Frequency (%)
No values found.

Most frequent character per script

Most occurring blocks

Value	Count	Frequency (%)
No values found.

Most frequent character per block

grade
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	12
Distinct (%)	0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	7.656873178

Minimum	1
Maximum	13
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	169.0 KiB

Quantile statistics

Minimum	1
5-th percentile	6
Q1	7
median	7
Q3	8
95-th percentile	10
Maximum	13
Range	12
Interquartile range (IQR)	1

Descriptive statistics

Standard deviation	1.175458757
Coefficient of variation (CV)	0.1535168116
Kurtosis	1.190932077
Mean	7.656873178
Median Absolute Deviation (MAD)	1
Skewness	0.7711032008
Sum	165488
Variance	1.381703289
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=12)

Value	Count	Frequency (%)
7	8981	41.6%
8	6068	28.1%
9	2615	12.1%
6	2038	9.4%
10	1134	5.2%
11	399	1.8%
5	242	1.1%
12	90	0.4%
4	29	0.1%
13	13	0.1%
Other values (2)	4	< 0.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	1	< 0.1%
3	3	< 0.1%
4	29	0.1%
5	242	1.1%
6	2038	9.4%
7	8981	41.6%
8	6068	28.1%
9	2615	12.1%
10	1134	5.2%
11	399	1.8%

Value	Count	Frequency (%)
13	13	0.1%
12	90	0.4%
11	399	1.8%
10	1134	5.2%
9	2615	12.1%
8	6068	28.1%
7	8981	41.6%
6	2038	9.4%
5	242	1.1%
4	29	0.1%

sqft_above
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	946
Distinct (%)	4.4%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	1788.390691

Minimum	290
Maximum	9410
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	169.0 KiB

Quantile statistics

Minimum	290
5-th percentile	850
Q1	1190
median	1560
Q3	2210
95-th percentile	3400
Maximum	9410
Range	9120
Interquartile range (IQR)	1020

Descriptive statistics

Standard deviation	828.0909777
Coefficient of variation (CV)	0.4630369538
Kurtosis	3.402303621
Mean	1788.390691
Median Absolute Deviation (MAD)	450
Skewness	1.446664473
Sum	38652488
Variance	685734.6673
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1300	212	1.0%
1010	210	1.0%
1200	206	1.0%
1220	192	0.9%
1140	184	0.9%
1400	180	0.8%
1060	178	0.8%
1180	177	0.8%
1340	176	0.8%
1250	174	0.8%
Other values (936)	19724	91.3%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
290	1	< 0.1%
370	1	< 0.1%
380	1	< 0.1%
384	1	< 0.1%
390	2	< 0.1%
410	1	< 0.1%
420	2	< 0.1%
430	1	< 0.1%
440	1	< 0.1%
460	1	< 0.1%

Value	Count	Frequency (%)
9410	1	< 0.1%
8860	1	< 0.1%
8570	1	< 0.1%
8020	1	< 0.1%
7880	1	< 0.1%
7850	1	< 0.1%
7680	1	< 0.1%
7420	1	< 0.1%
7320	1	< 0.1%
6720	1	< 0.1%

sqft_basement
Real number (ℝ_≥0)

HIGH CORRELATION
ZEROS

Distinct	306
Distinct (%)	1.4%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	291.5090455

Minimum	0
Maximum	4820
Zeros	13126
Zeros (%)	60.7%
Negative	0
Negative (%)	0.0%
Memory size	169.0 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	560
95-th percentile	1190
Maximum	4820
Range	4820
Interquartile range (IQR)	560

Descriptive statistics

Standard deviation	442.5750427
Coefficient of variation (CV)	1.518220616
Kurtosis	2.715574211
Mean	291.5090455
Median Absolute Deviation (MAD)	0
Skewness	1.577965056
Sum	6300385
Variance	195872.6684
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	13126	60.7%
600	221	1.0%
700	218	1.0%
500	214	1.0%
800	206	1.0%
400	184	0.9%
1000	149	0.7%
900	144	0.7%
300	142	0.7%
200	108	0.5%
Other values (296)	6901	31.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	13126	60.7%
10	2	< 0.1%
20	1	< 0.1%
40	4	< 0.1%
50	11	0.1%
60	10	< 0.1%
65	1	< 0.1%
70	7	< 0.1%
80	20	0.1%
90	21	0.1%

Value	Count	Frequency (%)
4820	1	< 0.1%
4130	1	< 0.1%
3500	1	< 0.1%
3480	1	< 0.1%
3260	1	< 0.1%
3000	1	< 0.1%
2850	1	< 0.1%
2810	1	< 0.1%
2730	1	< 0.1%
2720	1	< 0.1%

yr_built
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	116
Distinct (%)	0.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	1971.005136

Minimum	1900
Maximum	2015
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	169.0 KiB

Quantile statistics

Minimum	1900
5-th percentile	1915
Q1	1951
median	1975
Q3	1997
95-th percentile	2011
Maximum	2015
Range	115
Interquartile range (IQR)	46

Descriptive statistics

Standard deviation	29.3734108
Coefficient of variation (CV)	0.01490275711
Kurtosis	-0.6574075047
Mean	1971.005136
Median Absolute Deviation (MAD)	23
Skewness	-0.4698053988
Sum	42599334
Variance	862.7972622
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
2014	559	2.6%
2006	454	2.1%
2005	450	2.1%
2004	433	2.0%
2003	422	2.0%
2007	417	1.9%
1977	417	1.9%
1978	387	1.8%
1968	381	1.8%
2008	367	1.7%
Other values (106)	17326	80.2%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1900	87	0.4%
1901	29	0.1%
1902	27	0.1%
1903	46	0.2%
1904	45	0.2%
1905	74	0.3%
1906	92	0.4%
1907	65	0.3%
1908	86	0.4%
1909	94	0.4%

Value	Count	Frequency (%)
2015	38	0.2%
2014	559	2.6%
2013	201	0.9%
2012	170	0.8%
2011	130	0.6%
2010	143	0.7%
2009	230	1.1%
2008	367	1.7%
2007	417	1.9%
2006	454	2.1%

lat
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	5034
Distinct (%)	23.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	47.56005252

Minimum	47.1559
Maximum	47.7776
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	169.0 KiB

Quantile statistics

Minimum	47.1559
5-th percentile	47.3103
Q1	47.471
median	47.5718
Q3	47.678
95-th percentile	47.74964
Maximum	47.7776
Range	0.6217
Interquartile range (IQR)	0.207

Descriptive statistics

Standard deviation	0.1385637102
Coefficient of variation (CV)	0.002913447377
Kurtosis	-0.6763130016
Mean	47.56005252
Median Absolute Deviation (MAD)	0.1049
Skewness	-0.4852704765
Sum	1027915.415
Variance	0.0191999018
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
47.6624	17	0.1%
47.5322	17	0.1%
47.6846	17	0.1%
47.5491	17	0.1%
47.6955	16	0.1%
47.6886	16	0.1%
47.6711	16	0.1%
47.5402	15	0.1%
47.6842	15	0.1%
47.6904	15	0.1%
Other values (5024)	21452	99.3%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
47.1559	1	< 0.1%
47.1593	1	< 0.1%
47.1622	1	< 0.1%
47.1647	1	< 0.1%
47.1764	1	< 0.1%
47.1775	1	< 0.1%
47.1776	2	< 0.1%
47.1795	1	< 0.1%
47.1803	1	< 0.1%
47.1808	1	< 0.1%

Value	Count	Frequency (%)
47.7776	3	< 0.1%
47.7775	3	< 0.1%
47.7774	1	< 0.1%
47.7772	3	< 0.1%
47.7771	2	< 0.1%
47.777	2	< 0.1%
47.7769	3	< 0.1%
47.7768	2	< 0.1%
47.7767	6	< 0.1%
47.7766	4	< 0.1%

long
Real number (ℝ)

HIGH CORRELATION

Distinct	752
Distinct (%)	3.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	-122.2138964

Minimum	-122.519
Maximum	-121.315
Zeros	0
Zeros (%)	0.0%
Negative	21613
Negative (%)	100.0%
Memory size	169.0 KiB

Quantile statistics

Minimum	-122.519
5-th percentile	-122.387
Q1	-122.328
median	-122.23
Q3	-122.125
95-th percentile	-121.979
Maximum	-121.315
Range	1.204
Interquartile range (IQR)	0.203

Descriptive statistics

Standard deviation	0.1408283424
Coefficient of variation (CV)	-0.001152310388
Kurtosis	1.049500887
Mean	-122.2138964
Median Absolute Deviation (MAD)	0.101
Skewness	0.8850529834
Sum	-2641408.943
Variance	0.01983262202
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
-122.29	116	0.5%
-122.3	111	0.5%
-122.362	104	0.5%
-122.291	100	0.5%
-122.363	99	0.5%
-122.372	99	0.5%
-122.288	98	0.5%
-122.357	96	0.4%
-122.284	95	0.4%
-122.365	94	0.4%
Other values (742)	20601	95.3%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
-122.519	1	< 0.1%
-122.515	1	< 0.1%
-122.514	1	< 0.1%
-122.512	1	< 0.1%
-122.511	2	< 0.1%
-122.509	2	< 0.1%
-122.507	1	< 0.1%
-122.506	1	< 0.1%
-122.505	3	< 0.1%
-122.504	2	< 0.1%

Value	Count	Frequency (%)
-121.315	2	< 0.1%
-121.316	1	< 0.1%
-121.319	1	< 0.1%
-121.321	1	< 0.1%
-121.325	1	< 0.1%
-121.352	2	< 0.1%
-121.359	1	< 0.1%
-121.364	2	< 0.1%
-121.402	1	< 0.1%
-121.403	1	< 0.1%

sqft_living15
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	777
Distinct (%)	3.6%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	1986.552492

Minimum	399
Maximum	6210
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	169.0 KiB

Quantile statistics

Minimum	399
5-th percentile	1140
Q1	1490
median	1840
Q3	2360
95-th percentile	3300
Maximum	6210
Range	5811
Interquartile range (IQR)	870

Descriptive statistics

Standard deviation	685.3913043
Coefficient of variation (CV)	0.3450154512
Kurtosis	1.59709581
Mean	1986.552492
Median Absolute Deviation (MAD)	410
Skewness	1.108181276
Sum	42935359
Variance	469761.2399
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1540	197	0.9%
1440	195	0.9%
1560	192	0.9%
1500	181	0.8%
1460	169	0.8%
1580	167	0.8%
1610	166	0.8%
1720	166	0.8%
1800	166	0.8%
1620	165	0.8%
Other values (767)	19849	91.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
399	1	< 0.1%
460	2	< 0.1%
620	2	< 0.1%
670	1	< 0.1%
690	2	< 0.1%
700	2	< 0.1%
710	2	< 0.1%
720	2	< 0.1%
740	8	< 0.1%
750	3	< 0.1%

Value	Count	Frequency (%)
6210	1	< 0.1%
6110	1	< 0.1%
5790	6	< 0.1%
5610	1	< 0.1%
5600	1	< 0.1%
5500	1	< 0.1%
5380	1	< 0.1%
5340	1	< 0.1%
5330	1	< 0.1%
5220	1	< 0.1%

sqft_lot15
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	8689
Distinct (%)	40.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	12768.45565

Minimum	651
Maximum	871200
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	169.0 KiB

Quantile statistics

Minimum	651
5-th percentile	1999.2
Q1	5100
median	7620
Q3	10083
95-th percentile	37062.8
Maximum	871200
Range	870549
Interquartile range (IQR)	4983

Descriptive statistics

Standard deviation	27304.17963
Coefficient of variation (CV)	2.138408933
Kurtosis	150.76311
Mean	12768.45565
Median Absolute Deviation (MAD)	2505
Skewness	9.506743247
Sum	275964632
Variance	745518225.3
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
5000	427	2.0%
4000	357	1.7%
6000	289	1.3%
7200	211	1.0%
4800	145	0.7%
7500	142	0.7%
8400	116	0.5%
3600	111	0.5%
4500	111	0.5%
5100	109	0.5%
Other values (8679)	19595	90.7%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
651	1	< 0.1%
659	1	< 0.1%
660	1	< 0.1%
748	2	< 0.1%
750	4	< 0.1%
755	1	< 0.1%
757	1	< 0.1%
758	1	< 0.1%
788	1	< 0.1%
794	1	< 0.1%

Value	Count	Frequency (%)
871200	1	< 0.1%
858132	1	< 0.1%
560617	1	< 0.1%
438213	1	< 0.1%
434728	1	< 0.1%
425581	1	< 0.1%
422967	1	< 0.1%
411962	1	< 0.1%
392040	2	< 0.1%
386812	1	< 0.1%

house_age
Categorical

HIGH CORRELATION
MISSING

Distinct	2
Distinct (%)	< 0.1%
Missing	320
Missing (%)	1.5%
Memory size	169.0 KiB

old_house	14616
new_house	6677

Length

Max length	9
Median length	9
Mean length	9
Min length	9

Characters and Unicode

Total characters	0
Distinct characters	0
Distinct categories	0 ?
Distinct scripts	0 ?
Distinct blocks	0 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	old_house
2nd row	old_house
3rd row	old_house
4th row	old_house
5th row	old_house

Common Values

Value	Count	Frequency (%)
old_house	14616	67.6%
new_house	6677	30.9%
(Missing)	320	1.5%

Length

Histogram of lengths of the category

Pie chart

Value	Count	Frequency (%)
old_house	14616	68.6%
new_house	6677	31.4%

Most occurring characters

Value	Count	Frequency (%)
No values found.

Most occurring categories

Value	Count	Frequency (%)
No values found.

Most frequent character per category

Most occurring scripts

Value	Count	Frequency (%)
No values found.

Most frequent character per script

Most occurring blocks

Value	Count	Frequency (%)
No values found.

Most frequent character per block

dormitory_type
Categorical

HIGH CORRELATION

Distinct	3
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	169.0 KiB

house	18641
apartment	2760
studio	212

Length

Max length	9
Median length	5
Mean length	5.520612594
Min length	5

Characters and Unicode

Total characters	0
Distinct characters	0
Distinct categories	0 ?
Distinct scripts	0 ?
Distinct blocks	0 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	house
2nd row	house
3rd row	apartment
4th row	house
5th row	house

Common Values

Value	Count	Frequency (%)
house	18641	86.2%
apartment	2760	12.8%
studio	212	1.0%

Length

Histogram of lengths of the category

Pie chart

Value	Count	Frequency (%)
house	18641	86.2%
apartment	2760	12.8%
studio	212	1.0%

Most occurring characters

Value	Count	Frequency (%)
No values found.

Most occurring categories

Value	Count	Frequency (%)
No values found.

Most frequent character per category

Most occurring scripts

Value	Count	Frequency (%)
No values found.

Most frequent character per script

Most occurring blocks

Value	Count	Frequency (%)
No values found.

Most frequent character per block

condition_type
Categorical

HIGH CORRELATION
HIGH CORRELATION

Distinct	3
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	169.0 KiB

regular	19710
good	1701
bad	202

Length

Max length	7
Median length	7
Mean length	6.726507195
Min length	3

Characters and Unicode

Total characters	0
Distinct characters	0
Distinct categories	0 ?
Distinct scripts	0 ?
Distinct blocks	0 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	regular
2nd row	regular
3rd row	regular
4th row	good
5th row	regular

Common Values

Value	Count	Frequency (%)
regular	19710	91.2%
good	1701	7.9%
bad	202	0.9%

Length

Histogram of lengths of the category

Pie chart

Value	Count	Frequency (%)
regular	19710	91.2%
good	1701	7.9%
bad	202	0.9%

Most occurring characters

Value	Count	Frequency (%)
No values found.

Most occurring categories

Value	Count	Frequency (%)
No values found.

Most frequent character per category

Most occurring scripts

Value	Count	Frequency (%)
No values found.

Most frequent character per script

Most occurring blocks

Value	Count	Frequency (%)
No values found.

Most frequent character per block

price_tier
Categorical

HIGH CORRELATION

Distinct	4
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	169.0 KiB

tier 2	5460
tier 1	5404
tier 3	5376
tier 4	5373

Length

Max length	6
Median length	6
Mean length	6
Min length	6

Characters and Unicode

Total characters	0
Distinct characters	0
Distinct categories	0 ?
Distinct scripts	0 ?
Distinct blocks	0 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	tier 1
2nd row	tier 3
3rd row	tier 1
4th row	tier 3
5th row	tier 3

Common Values

Value	Count	Frequency (%)
tier 2	5460	25.3%
tier 1	5404	25.0%
tier 3	5376	24.9%
tier 4	5373	24.9%

Length

Histogram of lengths of the category

Pie chart

Value	Count	Frequency (%)
tier	21613	50.0%
2	5460	12.6%
1	5404	12.5%
3	5376	12.4%
4	5373	12.4%

Most occurring characters

Value	Count	Frequency (%)
No values found.

Most occurring categories

Value	Count	Frequency (%)
No values found.

Most frequent character per category

Most occurring scripts

Value	Count	Frequency (%)
No values found.

Most frequent character per script

Most occurring blocks

Value	Count	Frequency (%)
No values found.

Most frequent character per block

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Cramér's V (φc)

Cramér's V is an association measure for nominal random variables. The coefficient ranges from 0 to 1, with 0 indicating independence and 1 indicating perfect association. The empirical estimators used for Cramér's V have been proved to be biased, even for large samples. We use a bias-corrected measure that has been proposed by Bergsma in 2013 that can be found here.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

A simple visualization of nullity by column.

Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.

The dendrogram allows you to more fully correlate variable completion, revealing trends deeper than the pairwise ones visible in the correlation heatmap.

First rows

	date	price	bedrooms	bathrooms	sqft_living	sqft_lot	floors	condition	grade	sqft_above	sqft_basement	yr_built	lat	long	sqft_living15	sqft_lot15	house_age	dormitory_type	condition_type	price_tier
0	2014-10-13	221900.00	3	1.00	1180	5650	1.00	3	7	1180	0	1955	47.51	-122.26	1340	5650	old_house	house	regular	tier 1
1	2014-12-09	538000.00	3	2.25	2570	7242	2.00	3	7	2170	400	1951	47.72	-122.32	1690	7639	old_house	house	regular	tier 3
2	2015-02-25	180000.00	2	1.00	770	10000	1.00	3	6	770	0	1933	47.74	-122.23	2720	8062	old_house	apartment	regular	tier 1
3	2014-12-09	604000.00	4	3.00	1960	5000	1.00	5	7	1050	910	1965	47.52	-122.39	1360	5000	old_house	house	good	tier 3
4	2015-02-18	510000.00	3	2.00	1680	8080	1.00	3	8	1680	0	1987	47.62	-122.05	1800	7503	old_house	house	regular	tier 3
5	2014-05-12	1225000.00	4	4.50	5420	101930	1.00	3	11	3890	1530	2001	47.66	-122.00	4760	101930	new_house	house	regular	tier 4
6	2014-06-27	257500.00	3	2.25	1715	6819	2.00	3	7	1715	0	1995	47.31	-122.33	2238	6819	new_house	house	regular	tier 1
7	2015-01-15	291850.00	3	1.50	1060	9711	1.00	3	7	1060	0	1963	47.41	-122.31	1650	9711	old_house	house	regular	tier 1
8	2015-04-15	229500.00	3	1.00	1780	7470	1.00	3	7	1050	730	1960	47.51	-122.34	1780	8113	old_house	house	regular	tier 1
9	2015-03-12	323000.00	3	2.50	1890	6560	2.00	3	7	1890	0	2003	47.37	-122.03	2390	7570	new_house	house	regular	tier 2

Last rows

	date	price	bedrooms	bathrooms	sqft_living	sqft_lot	floors	condition	grade	sqft_above	sqft_basement	yr_built	lat	long	sqft_living15	sqft_lot15	house_age	dormitory_type	condition_type	price_tier
21603	2014-08-25	507250.00	3	2.50	2270	5536	2.00	3	8	2270	0	2003	47.54	-121.88	2270	5731	new_house	house	regular	tier 3
21604	2015-01-26	429000.00	3	2.00	1490	1126	3.00	3	8	1490	0	2014	47.57	-122.29	1400	1230	new_house	house	regular	tier 2
21605	2014-10-14	610685.00	4	2.50	2520	6023	2.00	3	9	2520	0	2014	47.51	-122.17	2520	6023	new_house	house	regular	tier 3
21606	2015-03-26	1007500.00	4	3.50	3510	7200	2.00	3	9	2600	910	2009	47.55	-122.40	2050	6200	new_house	house	regular	tier 4
21607	2015-02-19	475000.00	3	2.50	1310	1294	2.00	3	8	1180	130	2008	47.58	-122.41	1330	1265	new_house	house	regular	tier 3
21608	2014-05-21	360000.00	3	2.50	1530	1131	3.00	3	8	1530	0	2009	47.70	-122.35	1530	1509	new_house	house	regular	tier 2
21609	2015-02-23	400000.00	4	2.50	2310	5813	2.00	3	8	2310	0	2014	47.51	-122.36	1830	7200	new_house	house	regular	tier 2
21610	2014-06-23	402101.00	2	0.75	1020	1350	2.00	3	7	1020	0	2009	47.59	-122.30	1020	2007	new_house	apartment	regular	tier 2
21611	2015-01-16	400000.00	3	2.50	1600	2388	2.00	3	8	1600	0	2004	47.53	-122.07	1410	1287	new_house	house	regular	tier 2
21612	2014-10-15	325000.00	2	0.75	1020	1076	2.00	3	7	1020	0	2008	47.59	-122.30	1020	1357	new_house	apartment	regular	tier 2

Overview

Variables

Common Values

Length

Pie chart

Most occurring characters

Most occurring categories

Most frequent character per category

Most occurring scripts

Most frequent character per script

Most occurring blocks

Most frequent character per block

Common Values

Length

Pie chart

Most occurring characters

Most occurring categories

Most frequent character per category

Most occurring scripts

Most frequent character per script

Most occurring blocks

Most frequent character per block

Common Values

Length

Pie chart

Most occurring characters

Most occurring categories

Most frequent character per category

Most occurring scripts

Most frequent character per script

Most occurring blocks

Most frequent character per block

Common Values

Length

Pie chart

Most occurring characters

Most occurring categories

Most frequent character per category

Most occurring scripts

Most frequent character per script

Most occurring blocks

Most frequent character per block

Common Values

Length

Pie chart

Most occurring characters

Most occurring categories

Most frequent character per category

Most occurring scripts

Most frequent character per script

Most occurring blocks

Most frequent character per block

Common Values

Length

Pie chart

Most occurring characters

Most occurring categories

Most frequent character per category

Most occurring scripts

Most frequent character per script

Most occurring blocks

Most frequent character per block

Common Values

Length

Pie chart

Most occurring characters

Most occurring categories

Most frequent character per category

Most occurring scripts

Most frequent character per script

Most occurring blocks

Most frequent character per block

Interactions

Correlations

Spearman's ρ

Pearson's r

Kendall's τ

Cramér's V (φc)

Phik (φk)

Missing values